Papers with model-centric lens
SimBA: Simplifying Benchmark Analysis Using Performance Matrices Alone (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Modern language models are evaluated on large benchmarks, which are difficult to make sense of. |
| Approach: | They propose a framework to Simplify Benchmark Analysis using model-centric evaluation numbers. |
| Outcome: | The proposed framework can be applied to HELM, MMLU, and BigBenchLite benchmarks. |